ITRI-01-18 Evaluating text quality: Judging output texts without a clear source
نویسندگان
چکیده
We consider how far two attributes of text quality commonly used in MT evaluation – intelligibility and fidelity – apply within NLG. While the former appears to transfer directly, the latter needs to be completely re-interpreted. We make acrucial distinction between the needs of symbolic authors and those of end-readers. We describe a form of textual feedback, based on a controlled language used for specifying software requirements that appears well suited to authors’ needs, and an approach for incrementally improving the fidelity of this feedback text to the content model.
منابع مشابه
Evaluating Text Quality: Judging Output Texts Without a Clear Source
We consider how far two attributes of text quality commonly used in MT evaluation – intelligibility and fidelity – apply within NLG. While the former appears to transfer directly, the latter needs to be completely re-interpreted. We make a crucial distinction between the needs of symbolic authors and those of end-readers. We describe a form of textual feedback, based on a controlled language us...
متن کاملITRI-01-17 Generating Texts with Style
We describe an approach for generating a wide variety of texts expressing the same content. By treating stylistic features as constraints on the output of a text planner, we explore the interaction between various stylistic features (from punctuation and layout to pronominal reference and discourse structure) and their impact on the form of the resulting text.
متن کاملITRI - 01 - 16 Planning Texts containing indented items
We describe a text-structuring method suitable for generating texts that contain indented items. Indentation increases the number of hierarchical levels that can be expressed in text structure, since a relatively low-level unit such as a sentence can contain indented items each comprising several paragraphs. We give formation rules for a simple class of indented structures, along with a procedu...
متن کاملITRI-01-20 AGILE - A System for Multilingual Generation of Technical Instructions
This paper presents amultilingual Natural Language Generati on system that produces technical instruction texts in Bulgari an, Czech and Russian. It generates everal types of texts, common fo r software manuals, in two styles. We illustrate the sy stem’s functionality with examples of its input and output behaviour. We discuss the criteria nd procedures adopted for evaluating the syst em and su...
متن کامل